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ABSTRACT 


The  asymptotic  zero-crossing  rate  (ZCR)  of  the  general  first  and 
second  order  autoregressive  processes  is  investigated.  When  the 
associated  characteristic  polynomial  has  a  unit  root  e19,  0  <  0  <  u,  the 
ZCR  converges  in  mean  square  to  0/7r,  and  the  rate  of  convergence  is  very 

'  f 

fast  regardless  of  the  noise  level.  It  is  conjectured  that  in  higher 
order  autoregressive  processes  multiple  unit  roots  can  be  determined  by 
the  ZCR  of  the  filtered  processes.  An  indication  to  this  effect  is  given. 


Convergence  of  the  Zero-Crossing  Rate  of 
Autoregressive  Processes  and  its  Link 
to  Unit  Roots 

1.  Introduction 

In  this  paper  we  investigate  the  convergence  of  the  zero-crossing  rate 

(ZCR)  of  nonstationary  first  and  second  order  autoregressive  processes.  In 

addition  to  other  parameters',  of  special  concern  to  us  is  the  link  between 

the  unit  roots  of  AR(2)  processes  and  their  ZCR.  Our  main  result  states 

that  the  ZCR  of  a  nonstationary  AR(2)  whose  characteristic  equation  has  a 
i  0 

unit  root  e  ,  0  <  0  <  ir,  converges  to  8/tt  in  quadratic  mean.  It  seems 
that  the  convergence  is  very  fast  and  is  essentially  identical  to  the  case 
of  a  pure  sinusoid  regardless  of  the  magnitude  of  the  additive  noise  com¬ 
ponent.  At  present  it  is  not  clear  how  to  extend  this  result  to  the  general 
nonstationary  AR(p)  with  unit  roots,  but  it'  is  conjecture d  that  the  ZCR  of 
the  filtered  processes  may  be  the  required  remedy.  An  indication  of  this 
fact  will  be  illustrated  at  the  end. 

Let  { Xn>  be  a  Gaussian  process  with  zero  mean  and  where 
n  =  0,±1,±2,...,  and  let  (xn)  be  the  corresponding  clipped  process 

n,  xn  >  o 

Xn  =  S  ,  n  =  0,±1,±2 . 

[o,  xn  <  0 

The  quantity 

j, 

is  called  the  number  of  zero-crossings  of  the  time  series 

...,X)V  ( If) /N  is  the  corresponding  ZCR.  When  { Xn }  follows  a  first  order 
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autoregressive  model 

Xt  =  aX^  i  +  e^,  a  (  R, 
then  under  some  conditions 


1 .  i .  m 
N-*°° 


—  cos  ^a, 

TT 


1  -1  a 

tt  C0S  lap 


loci  <  1 

|a|  >  1  • 


The  complete  statement  is  given  in  Theorem  2.1. 

Let  8  denote  the  backward  shift  operator,  and  consider  the  nonstationary 
AR(2)  process  with  two  unit  roots 

(1  -  e108)(l  -  e"108)Xt  =  C(.,  0  <  0  <  tt. 

Then  under  appropriate  conditions 

'il-"  ■  f  • 

A  more  complete  statement  is  given  in  Theorem  3.1. 

The  paper  is  organized  as  follows.  After  some  preliminaries,  section  2 
treats  the  first  order  case  while  section  3  deals  with  the  second  order  case. 
The  method  of  proof  is  the  same  in  both  cases.  Section  4  deals  with  unit 
roots. 


1.1  Preliminaries  and  motivation 

For  a  better  exposition  it  is  helpful  to  expound  on  some  key  observa¬ 
tions. 

Throughout  the  paper  we  assume  that  fxp,  t  =  0,±1,±2,...,  is  a  zero 
mean  Gaussian  process  with  correlation  function 


It  turns  out  that  our  processes  become  asymptotical  ly  stationary  by 
satisfying  the  condition 


lim  pk(t)  =  pk  =  p_k,  k  =  0,1,2, 

t-KO 


(1.1) 


Now,  if  a  =  (a1,...,ak)'  €  Rk,  then  we  have 
/ 1  pi 


°k-i\ 

pk-2 


*k-l  pk-2 


1  / 


a  =  lim  e\  I  }  >  0 


and  therefore  the  matrix  (p  ),  i,j  =  l,...,k,  is  always  nonnegative 


mi  ~mj 


definite  and  there  exists  a  stationary  Gaussian  process  (Yt)  such  that 


“t"0-  EYtW<v  k  =  0-‘'2 . 


This  fact  is  fundamental  to  our  development. 

Another  useful  fact  is  the  formula  [1,  p.  34] 


EXjXj+i  =  \  +  2?  s i n~ 1P1 ( J ) - 


(1.2) 


It  follows  that  when  (1.1)  holds  we  have 


""rEDn(X)  -l  cos^p, 

N-wo 


(1.3) 


This  is  the  limiting  expected  ZCR.  It  turns  out  that  the  ZCR  itself 
achieves  this  limit  in  quadratic  mean  when  (1.1)  holds. 


The  motivation  for  using  the  ZCR  in  determining  unit  roots  in  non¬ 
stationary  autoregressive  processes  springs  out  from  the  following  fact. 
A  second  order  autoregressive  Gaussian  process  with  two  unit  roots  e±10 
(they  are  a  conjugate  pair)  has  the  form 


Xt  =  2  cos  0  xt-l  "  Xt-2  +  et 


(1.4) 


where  (et }  is  Gaussian  white  noise.  Assume  for  a  moment  that  =  0 
with  probability  one.  Then  { }  is  a  pure  sinusoid  with  frequency  0  and 
this  implies  that  with  probability  one 


0  ~  N  I  -  TT  ’ 


or  that 


1 .  i  .m  ^  P^(  /)  w  . 


N-*» 


The  surprising  fact  is  that  this  limit  remains  true  even  in  the  presence 
of  in  (1.4),  and  in  fact  regardless  of  the  magnitude  of  et,  that  is, 
regardless  of  the  size  of  Var(e^.).  Moreover,  the  rate  of  convergence  of 
the  ZCR  to  0/ 7T  is  fast,  Evidently,  these  are  robustness  properties  of 
the  zero-crossing  rate. 
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2.  The  ZCR  of  a  general  AR(1) 

Suppose  (X^}  follows  the  AR{1)  model 

Xt  =  aXt-l  +  et*  1  =  0,±1 .  a  t  0  (2.1) 

2 

where  {e.}  is  Gaussian  white  noise  with  mean  0  and  variance  o  .  Let 
t  e 

2  2 

Xq  =  C  be  an  initial  value  independent  of  (e t)  with  EC  *  0,  EC  =  a  . 
The  solution  of  (2.1)  depends  on  whether  t  >  1  or  t  <  -1  and  is  given 
by 

Xt  =  a^C  +  a*  +  •••  +  act_i  +  c^»  t  >  1  (2.2) 

X  =  a^C  -  -  a*+*e_j  -  ...  -  a  t  <  -1  .  (2.3) 


et -w. j a*. ^  •.  4,..  *  .. 


p$(t)  can  be  expressed  conveniently  by 

Ps(t)  =  {♦j(t.s)  +  a^^t.s))**.  (y^)s, 

f  a2  ♦  to2  ^  . 

(o*  ♦  (t+s)o?  j  “  ’ 


!al  t  1 


Ini  =  1 


Similarly,  for  t  <  -1,  s  <  -1  define 


o2(l  -  a'2)  -  o2a"2 


-2  2 
a  a 

t 


<J>2(t,s)  =  2{t+s)  2/ ,  -2:  -2/ .  2 

a  o(l-a  )  +  a  (1-a 


Then  again  uniformly  in  s  and  as  t 


<J>2(  t,s ) 


<P2(t,s) 


1,  |o|  <  1 

0,  |a|  >  1 


0,  | a |  <  1 

1,  |a|  >  1  . 


The  correlation  function  becomes 


Ps(t)  =  (*2(t,s)  +  a2^2(t,s)P- (A)S,  |a|  t  1 


o2  -  to2  v*  s 


We  therefore  have 


a  =  1. 


Lemma  2.1.  Assume  that  {Xf}  follows  the  AR(1)  model  (2.1)  where  XQ 
is  independent  of  the  Gaussian  white  noise  {ct).  Then 


lim  p  (t)  = 
t-x* 


lim  p  ( t )  = 
t-*--«> 


lim  p+  ( t )  =  a  , 


aS 

M 

<  1 

» 

uniformly  in 

s  >  1 

(A)S* 

M 

lal 

>  1 

l«l 

|af 

<  1 

* 

uniformly  in 

s  >  1 

-s 

a 

M 

>  1 

s 

» 

M 

=  1. 

Proof.  If  |aj  <  1  and  (l-a2)o2  =  o2  then  ^ ( t , s )  =  0  and 

ij)j(t,s)  =  1  and  so  ps(t)  =  aS  for  all  t.  If  |a|  <  1  and 
2  2  2 

(1  -  a  )a  t  we  have 

|ps(t)  -  aS |  =  I  [(pj ( t,s )  +  a2s^1(t,s)]'i  -  (a| S ( . 

Because  <J>j(t,s)  -*■  0,  ^(tjS)  -*  1  uniformly  in  s  >  1  as  t  -*•  •*>, 
for  any  e  >  0  we  can  find  Tj  >  0  such  that  whenever  t  > 

2 

|<fr1(t.s)  |  <  and  J ( t ,s )  J  <  2. 

2sQ  2 

Choose  Sq  such  that  2a  u  <  .  Then  for  t  >  T^,  s  >  Sg 


|ps(t)  -  ab|  <  e. 


Since  lim  p  (t)  *  a  for  s  =  l,2,...,sn,  we  can  find  Tn  such  that 
t-*«  s  u  u 

for  t  >  Tq  we  also  have  |p  (t)  -  aS|  <  e  for  s  =  1,2,. ..,Sg.  T 
if  we  put  T  =  T,  v  T„  then  whenever  t  >  T 
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|p$(t)  -  a  !  <  e  for  all  s  >  1. 

2  2  2 

If  | at |  >  1  then  obviously  (1  -  a  )o  t  ac  and  for  sufficiently  large  t 


]a2s^1(t,s)|  = 


-2t  2 

a  °c 


] (1  -  a  )o  +  (of 


-  l)o‘| 


2t,  /  2  .  v  2  2,  °c 

a  I  (a  -  l)o  +  o  1  * 

a 

2 

a 

_ e  __ _ _ 

2 

2t( /  2  2  A  2,  °e 

a  l  (a  -  1  )o  +  a  1  -  — n- 


0,  t  -*■  °»  uniformly  in  s  >  1. 


|ps(t)  ~  (j^j-)S|  =  l(4>i(ttS)  +  a2sij)j(t,s))’2  -  1|. 

But  since  4>j(t,s)  -*■  1  uniformly  in  s  >  1  as  t  -*  and  since 

ia2si^(t,s)  |  •*  0  also  uniformly  in  s  >  1  as  t  -*■  ®,  it  follows  that 

pe(t)  -*■  (t^t)S  uniformly  in  s  >  1  as  t  -*■  This  takes  care  of  the 
s  I  ct  I 

first  part  of  the  lemma.  The  second  part  can  be  proven  in  the  same  way, 
and  the  third  part  is  obviously  true  since  we  do  not  claim  a  uniform 
limit  for  this  case.  n 


In  order  to  translate  Lemma  2.1  into  a  statement  about  the  con¬ 
vergence  of  the  ZCR  we  shall  use  the  fact  that  the  process  in  (2.1)  con¬ 
verges  in  some  sense  to  a  stationary  process  regardless  of  a.  Recall 
that  a  sequence  of  Gaussian  processes 

*n  =  (x[n\x^n),...),  Ex|n)  =  0,  all  i  >  1, 
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converges  in  distribution  to  a  Gaussian  process 


v  =  (vrv2,...),  EY.  =  0,  all  i  >  1 


if  and  only  if 
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EY  i Y  for  all  m,k. 
m+k  m 


We  shall  say  that  the  convergence  is  uniform  if  it  is  uniform  in  m  and  k. 
When  |a|  <  1,  (2.1)  has  a  stationary  solution 


Yt  =  l  a Jef  -  ,  t  =  0,±1,±2, . . . 
j=0  1  3 


(2.4) 


and  when  |a|  >  1  (2.1)  still  has  a  stationary  solution  of  the  form 

Zt  =  "  j-Q  a  ^  et+j+l  '  1  =  0,  +  l,. . .  .  (2.5) 


Define  a  sequence  of  random  variables  (W-)  by 

W;  =  (-— X  ,  X  "  N(0,1).  (2.6) 

1  |a| 

In  accordance  with  (2.1),  (2.4),  (2.6)  we  further  define 

t  =  (x0,xr...) 

*n  -  <V*Z  •  •  ■■■> 

y  =  /F^aT  (Y0,Y1,...) 

M  =  (WQ,Wr...). 

jur  discussion  will  focus  on  the  relationship  of  the  ZCR  of  t  to  that 
of  *n,  Y/  and  W.  The  idea  is  to  show  that  the  ZCR  in  converges  to 
that  of  y  for  |a|  <  1  but  it  converges  to  that  of  Wl  for  |a|  >  1,  and 
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then  show  that  the  asymptotic  ZCR  in  and  t  are  the  same.  Our  first 
step  in  this  direction  is  to  observe  that  Lemma  2.1  implies 

Lemma  2.2.  Assume  that  (c^)  is  Gaussian  white  noise  and  that  Xg  =  £ 
is  a  zero-mean  normal  random  variable  independent  of  {ej ,C£» • • • )c . 

Then  as  n  -*•  «  we  have 

(i)  If  | a |  <  1  then  ^  converges  to  V  in  distribution  uniformly. 

( T i )  If  |aj  >  1  then  ^  converges  to  W  in  distribution  uniformly, 

(iii)  If  | a |  =  1  then  If  converges  to  Wl  in  distribution. 

Let  P^(Wl)  be  the  numbers  of  zero-crossings  in  ( Yg,Y. , . . . ,Y^) 

and  (Wg,Wj,. . . ,W^)  respectively.  Because  Yf  is  ergodic  (1.2)  and  (1.3) 
imply  that 

lim  J  cos_1a  a.s. 

N-x» 

Also,  we  clearly  have 

N  VW|)  =  tt  cos  a,s' 

Therefore  by  bounded  convergence 

l.i.m  (\f)  =  I  cos_1a  (2.7) 

N-k» 

and 

l.i.m  (WO  =  i  cos-1^).  (2.8) 

N-*»  n  N  71  |ot| 

We  will  show  that  (2.7),  (2.8)  also  hold  true  for  )f  depending  on 
whether  |a|  <  1  or  |a|  >  1.  In  passing  we  note  that  (2.7)  was  also 
established  in  (1,  ch.  5]  by  a  different  method  whereby  Y 'I  is  approximated 
by  an  M-dependent  Gaussian  process. 
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Consider  first  the  case  |«j  =  1  and  let  M  >  2  be  fixed.  De¬ 
fine  by 

W 5  J  <Vj  -  Vj-1>2’  "  2  '• 

the  number  of  zero-crossings  in  Un»Xn+j»- • • » Xn+M^  which  7S  the  same  as 

this  number  for  (Xn//EX^  ,  Xn+M//EX*+M  ).  Then  by  Lemma  2.2  *n 
converges  in  distribution  to  W/  as  n  +  <*>  and  for  all  M  >  2 

H  W  *  ;  cos‘lc-'  "  *  “• 

and  hence,  by  boundedness, 


heW 


—  cos  *a,  n 

71 


and  so 


lim  A  EPN(lf)  =  i  cos-Iu 


where  ^(tf)  is  the  number  of  zero-crossings  in  (Xq,X^  , . . .  ,X^) .  Now, 


since  —  cos  =  0  or  1  we  obtain 

7T 


E(WVN(V-  l  zos~la)2<  jEPN(J0-  l  cos_1a  -J-  EPN( *) +  A  cos' Ax 


N  N 


I 

t r 


0,  N  -  on. 


Thus 


l.i.m  ipN(Xl  -  i  cos_1a,  |a|  =  1. 


N-*» 


Next  consider  the  case  |aj  >  1.  Then  again  from  Lemma  2.2  and  (1.2) 

lim  ^EPnU)  =  l  cos'1^). 


n~» 


(2.9) 
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1  *  1  Ot 

But  since  ^  cos  (-|^y)  =  0  or  1  again  we  obtain 


l.i.m  jbM(»)  -  i  cos_1(-A-). 

N-*»  N  N  71  M 


(2.10) 


For  the  case  |a|  <  1  we  have  similarly 


Vim±EPN()r)  =  |  cos^a.  (2.11) 

Here,  however,  ^  cos'^a  is  neither  0  nor  1  and  we  cannot  use  the 
method  employed  above.  To  prove  the  mean  square  convergence  of  the  ZCR 
in  this  case  we  need  the  following  additonal  lemma. 


Lemma  2.3.  Let  c  be  a  positive  constant  and  let  Y  =  (Yq,Y,,,..)  be 
a  zero  mean  stationary  Gaussian  process  with  correlation  function  p^. 
Assume  that  1  -  (Xg,X^,...)  is  a  Gaussian  process  with  mean  zero  and 
correlation  function  Pk(t)  which  converges  to  pfc  as  t  -*■  °°  uniformly 
in  k.  Then, 

l.i.m  jrVjyi)  =  c 

implies 

l.i.m  ipN(»)  =  c  .  (2.12) 


Zeel-  Let  xi s  *tx<  >or  ^  -  V,  >oi>  i=1-2 .  **  »•* 

sequences  of  indicators  obtained  by  clipping  X,  Y.  Define 


f(x)  =  l  +  27  sin_1x 

9(x,y,z)  =  -g-  +  ^-(sin-1x  +  sin'\y  +  sin_1z). 


Then  f,g  are  uniformly  continuous  and  for  v  >  u  >  t  >  s,  we  obtain 
from  [1,  p.  34] 
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EVt  =  f(pt-s(s)) 

ExsXtXu  =  g(Pt.s(s)-Pu.s(s)-Pu-t(t))- 

Also,  it  is  known  that  there  exists  a  function  h  such  that 

Exsxtxuxv  =  h(Pt-s(s)’pu-s(s)’Vs(s)’pu-t(t)'pv-t(t)’Dv-u(u))- 
Obviously  h  is  continuous  on  the  compact  set 


and  is  therefore  uniformly  continuous  there.  Thus  by  uniform  continuity 
for  any  e  >  0,  there  is  5  >  0  such  that 

-  f(y1)l  <  e 

|g(x1,x2)  -  g(y1,y2) I  <  e 
|h(x1,...,x6)  -  h(y1, — ,y6) |  <  e 

whenever  Ix^  -  y^  j  <  6,  i  =1,...,6.  Also,  since  pk(n)  converges  to  pk 
uniformly  in  k  >  1  as  n  -*■  we  can  find  such  that 

|pk(n)  -  Pkl  <  6  for  all  k  >  1 

whenever  n  >  N  .  We  therefore  have 

-  e 
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IE(^Pn(*)}2  -  E(ity*))2| 

N  „  N  w 

,  e  N  on  c  N  o 

■7ml\h  ,x'-x'->,)  -E(?M, 

e  e 

5  4lE("f  <X,-X,.X)2)2  -  ECNf  Vl 


N  1 


+  4lE  Z  <xi  -  Xi_1)  I  (Xj-Xj.j)  -E  £(v.  -v._j)  l  (V--V,  j) 

1  1  1  1  N  +1  J  J  1  1  1  1  1  N  +1  J  J  1 

e  e 

,  N  2  N  ? 

+  -?!E  I  <Xi  "  Xi_i )  -E  l  (vi-vi_1)  | 

N  N  +1  1  1  N  +1  1  1  1 

e  c 

N2  +  2N  (N  -  N  )  16e(N  -  N  )2 


c  "r 

<  — - - - —  + 


In  the  above  bounding  we  used  the  fact  |a  -b|  *  a  v  b,  for  a,b  >  0. 
Since  e  is  arbitrary  and  since  N£  is  fixed  the  last  two  expressions  can 
be  made  arbitrarily  small  as  N  ■*  c,  and  we  proved  that 

lim  (E(Zdn(X))2  -  E(ZpN(v))2}  =  0. 


Next,  by  the  stationarity  of  Y  and  by  hypothesis, 

^EPn(V)  =  c  , 

and  so,  by  the  uniform  convergence  of  ( t )  we  also  have 

EPn(I)  ->  c  ,  N  -*  <*>, 

and  (2.12)  is  proved. 
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Denote  by  t_  the  process  Xt  in  (2.1)  for  t  =  -1,-2,...  .  That  is, 

t_  =  (X_i »X_2» • • • )- 

Also,  recall  the  stationary  solution  (2.5)  (2^.)  =  2.  We  can  study  the 

ZCR  in  by  comparing  it  to  that  of  1  following  the  above  procedure. 

In  this  case  plays  the  role  of  If  while  2  plays  the  role  of  V.  Let 
t>N(y_)  be  the  number  of  zero-crossings  in  X ^,X_^ . X-N-l’  or 

N  , 

*  I  (X  ,  -  X  ,  j  . 

"  j=l  J  J  1 

We  can  prove  the  convergence  of  £^()f_)/N  in  precisely  the  same  way  used 
to  prove  the  convergence  of  D^(lf)/N.  Collecting  the  above  results  we  have 


Theorem  2.1.  Assume  that  (X^.)  follows  the  first  order  autoregressive 
model  (2.1)  where  (e^.)  is  Gaussian  white  noise  and  where  XQ  “  E  is  a 
zero  mean  normal  random  variable  independent  of  (c t ) .  Then 


1 .  i  .m 
N-wo 


N  V*) 


IJ-m  TiVU{*-] 


N~° 


n  cos"lot  * 


1  „„«.-l/  a  \ 
iCS  lal  * 


i  cor1  i 

tt  a 


”  C0S"l(lar*’ 


l«l  <  1 

|a|  >  1 
l«|  >  i 
lal  <  1 


Evidently,  the  asymptotic  ZCR  depends  on  a  only  and  is  independent 
of  the  magnitude  of  {e^}.  Figure  2.1  portrays  the  convergence  of  the  ZCR 
for  various  values  of  a.  For  a  >  1  the  path  of  the  ZCR  is  much  smoother 
than  the  paths  corresponding  to  |a|  <  1.  Our  observation  has  been  that 
this  path  property  sets  apart  the  "stationary"  from  the  "nonstationary" 


cases. 
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3.  The  ZCR  of  the  general  AR(2)  process 

Consider  the  second  order  autoregressive  process  {X^ }  defined  by 
the  stochastic  difference  equation 


(1  -a8)(l  -  BB)Xt  =  ct,  t  =  0,±1,... 


(3.1) 


where  (e^l  is  Gaussian  white  noise  with  variance  a%  and  where  =  fjt 
X_2  =  c  are  two  initial  values  independent  of  (r.^1.  As  before,  K  is 
the  backward  shift  operator.  Clearly,  fX^I  is  not  stationary  but  the 
equation  (3.1)  has  a  stationary  solution  which  depends  on  a,B.  In  what 
follows,  we  will  show  that  the  asymptotic  ZCR  of  fX^l  is  determined  by 
ot,B  but  is  independent  of  the  magnitude  of  {c .  The  method  of  proof  is 
identical  to  that  given  in  the  first  order  case.  We  start  off  by  de¬ 
termining  the  asymptotic  correlations  of  f X^.} . 

The  general  solution  of  (3.1)  for  t  >  0  is  given  by 

t 


Xt  =  Ai“t+2  +  Bi3t+Z  + 


s>  ,L  (“ 


j+1  J+l 


j=0 


)c^._ j  >  a  f  B ,  a>B  €  R 


t+2. 


=  aL  C(A?  + B?(t+2) )  +  l  aJ(j+l)e  .,  a  =  B  €  RJ 

j=0 


t+2 


=  p  (A-^cosU+Zje  +  B.jSin(t+2)o)  +  £ 


sin(j+l)e  J 


j  =  0 


sin  0 


P  e 


t-j  ’ 


a  =  B  =  pe 


ie 


p  >  0 


a2  =  c 

A3  =  ? 


B,  = 


1 


1  a-B 
_  1 


(ar  -  rj 


B2  -  ic  -  c 


a 


b3  '  TWJ^r-  -  «  sin  6> 


I 


where 


Note  that  the  case  a  =  B  =  ei0  corresponds  to  the  unit  roots  e10,  e  10 . 
Under  the  assumption  that  have  zero  means  and  finite  variances,  we 


have 

(T) 

a  f  8,  a 

,8  6  R1 

11 

CM  ■*-> 
X 

UJ 

EA2a2t+4 

+  EB2B2t+4 

2 

a 

fl-a2t+2 

< - * —  l 

+ 

(a-8)  (  1-a 


1  -  82  1  '  nB 


Extxt+k  =  EAia 


2  2t+4+k  ,  rl,2.2t+4+k 


+  EBJS 


t+2 /  k  ,  „k. 


+  E(A1B1)(aB)  (a  +  8  ) 


°e  f  2+k  1  -a2t+2  „2+k  1  -  p2t+2  _  « 

+  -  a  - - —  +  3 - —  -  ali 

(a-B)2  1-a  1-8 


where  if  a  =  1  we  define  (1-a  )/(l  -  a)  =  t  +  1. 

(ii)  a  =  8  f  R1 

rvZ  2t+4rr(,2  °  °  °  t 


EX2  =  a2t+4{EA2  +  2EA9B„(t+2)  +  EB2(t+2)2)  +  o2  [  a2j(j+l)2 
t  L  L  L  L  c  j_o 

EX.  X.  . ,  =  a2t+4+k{EA2  +  E(A,B,)(2t  +4  +k)  +  EB2(  (t+2)  ( t  +  2  +  k)} 


t  t+k 


+  o2  l  a2j+k(j+l)(j  +  1  +  k). 


(3.2) 


^i^t^(ak+8k)l  (3.3) 

1  -  aP  J 


(3.4) 


(3.5) 


When  a  >  1,  in  the  limit  as  t  °°  of  the  ratio  of  (3.5)  to  (3.4)  we 
use  the  facts  that 

1  im  - 7  l  a2j(j+l)2  =  -j— 

t-»°°  a  (t+2)  j=0  a  -  1 


l—j  l  *2J  -  0. 


i  mi  pi  -j  L 
t-*»  a  (t+2)  j  =  l 


and 


(iii)  a  =  8  =  pe  ,  6  (  (0,n),  p  >  0 


=  p^t+4{EAjCos^(t+2)0  + EB^si ( t+2 )0  +  EA3B3sin(2t  + 4)6} 

ae  1  2  21 

—V  l  sinZ(j+l)0  p2j 

sin  9  j=0 


(3 


EXtXt+k  =  p2t+4+k{EA3cos ( t+2)0  cos(t+2+k)o  +  EB3sin(t+2)0  sin(t+2+k)0 

+  EA3B3sin(2t  +  4  +  k)e) 


r  sin(j+l)9  sin(j+Hk)0  2j+k 
L  5  P 

j=0  sin  0 


(3 


Observe  that 

°°  2 

l  sin  (j+l)e  =  <*> 
j=0 

and 

t 

l  sin(j+l)0  sin(j+l+k)Q 
j=0 

=  f  sin2( j+l )e  cos  Ice  ♦  sio  26  +  sin(2t+2)6  -  sin(2t+«)o.  -  1  sin  kl 
j=0  4(1  -cos  e) 

are  facts  used  in  the  limit  ratio  of  (3.7)  to  (3.6). 

Forming  the  appropriate  ratios  of  the  above  expressions  and  passing 
to  the  limit  as  t  -*■  °°  we  obtain  the  asymptotic  correlation  as  follows. 

Lemma  3.1.  Assume  { X t>  follows  (3.1),  {c^}  is  white  noise  independent 
of  X  ,  e  X  ,  =  E£  =  Ec  =  0,  Ef^,Er,2  <  <».  Then  for  s  >  1 
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(i )  a  f  8,  a, 8  f  R* 

s+ln  q s ^  1  / 1  2\ 

lim  p  (t)  =  - * - I — _ — i -— ( 3-  J ,  | a |  <  1,  [ 6 1  <  1,  uniformly  in  s  >  1 

t-«  s  a(l-8  )  -  8(l-a  ) 

=  (-||j)S,  |B|  >  |a|  >  1  or  1 8 1  >  1,  |a|  <  1 

=  ^]aT^S’  ^  >  -  1  or  -  *•  lRl  <  *• 

(ii)  a  =  6  €  R1 

2 

lim  p  (t)  =  aS(l  +  s  —  a^-) .  |  ot }  <  1,  uniformly  in  s  >  1 

t*»  S  1  +  a  . 

=  (T^f)S,  f ot |  >  1. 

|aj 

(iii)  a  =  8  =  pe10,  9  €  (0,ir),  p  >  0 

lim  p  (t)  =  pScos(s9)  +  U~P  ,)c°s  8  sin.  _s6  pS>  p  <  j,  uniformly  in  s  >  1 
t-*»  (1  +p  )sin  9 

=  co s(s0),  p  =  1,  uniformly  in  s  >  1. 

Proof.  The  proof  is  straightforward  and  is  similar  to  the  one  given  in 
Lemma  2.1.  □ 


The  stationary  solution  of  (3.1)  in  terms  of  a  realizable  moving  - 
average  is  given  by 

00  k+1  k+1  . 

Y  =  l  2 - Zjl -  a  t  8,  a, 8  €  R  ,  |a|<l,  |B|<1 

1  k=0  a‘6  t_k 


00 


oo 


(k+l)aket_|(,  a  = 
sin(k+l)9  k 

~  Tin" 6  P  Ct-k’ 


8  €  R1,  |«|  <  1 

a=6=po10,  0<p 


1, 


t  =  0,±1, . . .  .  Define 
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=  A  cos  ke  +  B  sin  ke,  k  =  0,l,2,...  , 

where  A,B  are  independent  N ( 0, 1 )  random  variables  and 

Wk  =  (  k  X  ,  X  ~  N(0‘,  1), 

k  \  |a  v  Bj  / 

k  =  0,1, ,  and  let 


V  = 


1 


<VY1 


•) 


M  =  (W0,Wr...) 

*  =  (Xq.Xj,...) 

*n=  ’  -) 


where  { Xn)  is  the  process  in  Lemma  3.1.  The  2  process  is  stationary  and 
Gaussian  with  zero  mean  and  correlation  function  cos(ke),  k  =  0,1,...  . 
Lemma  3.1  now  entails  under  the  Gaussian  assumption 

Lemma  3.2.  Assume  { X^ }  follows  the  AR(2)  model  (3.1)  where  X  ^  =  r, , 

X_2  =  c  are  two  normal  random  variables  with  zero  means  and  finite 
variances  independent  of  the  Gaussian  white  noise  {e.}.  Then  as  n  -*■  °n 

(i)  If  | ex |  v  )g|  <  1,  converges  to  f  in  distribution  uniformly. 

(ii)  If  a, 6  €  R*,  | a |  v  1 3 1  >  1,  2  converges  in  distribution  to  W. 

(iii)  If  a  =  B  =  e  ,  If  converges  to  7  in  distribution  uniformly. 

As  in  the  first  order  case,  the  asymptotic  ZCR  of  If  is  the  same  as 
that  of  tn  but  that  of  2^  is  the  same  as  the  asymptotic  ZCR  of  Yf  or  that 


of  1  or  that  of  W1  depending  on  a, 8.  Thus,  we  need  to  obtain  the  limit 
ZCR  in  the  latter  cases. 


Under  the  Gaussian  assumption  V  is  ergodic.  Also,  for 
1 8 1  <  1,  a, 8  €  R1  and  a  =8=  e10,  [p|  <  1 


EYtYt+l  _  1  _-l,  a+  8  ^ 
- O - -  cos  ( - ) 

£y^  n  1  +  up, 


so  that  PnU)/N 
convergence  also 


-  cos' ^ (— — a.s.  as  N  -*■  °°.  Therefore 
*  l+ap 


l.i.m  ipN(f)  =  i  cos'1^-^-)  . 


N-kxj 


1  +  aP> 


Since  1  is  a  sinusoid  its  ZCR  converges  to  ^  cos_1(cos(0))  = 
so  that  again 


l.i.m 

N-KO 


sV*> 


Similarly,  it  is  easy  to  see  that 


l.i.m 

N-k» 


hV“> 


The  convergence  of  £>N()?)/N  for  the  cases  corresponding  to  jot 
] S |  <  1,  m,8  €  R*,  and  a  =  8  =  e^°,  can  be  established  by 
Lemmas  2.3,  3.1,  3.2.  The  case  a, 8  £  R*  and  |a|  v  |p|  >  1 
simpler  and  follows  from  Lemma  3.1  which  gives 


lim  p,(t)  = 

t~K» 


a  v  8 
ja  v  8  | 


I«iEPN(« 

N-*® 


I  cos'1 

IT 


/  a  v  8  \ 
\  |a  v  8  |  / 


jaj  <  1, 


by  bounded 


0/tt  a.s. 


I  <  1. 


is  much 


so  that 


But 


=  0  or  1 


and  this  implies 


1 .  i .  m 

N-k» 


?¥*■> 


The  same  method  can  be  used  to  obtain  the  asymptotic  ZCR  in 

=  ( X_ j » X_2 » - • • )  with  the  appropriate  conditions  on  n,B-  This  re¬ 
sult  and  the  summary  of  the  above  discussion  are  given  in 


Theorem  3.1.  Assume  that  { Xt }  follows  the  AR(2)  model  (3.1)  with 
initial  values  X_j  =  X_2  =  t,  that  are  normal  random  variables  with 

zero  means  and  finite  variances  and  independent  of  the  Gaussian  white 


noise  Tet> .  Then  regardless  of  the  magnitude  of  ct 

~  cos_1(~^)«  «  R1.  I«l  <  i.  |e|  <  i 

I  cos'1|^--co-s^j,  a  =  B  =  pe10 ,  |p|  <  1,  0  <  e  <tt 

1  Ot  V  B  \  rt  r  r*  1  I  I 

COS  - - —  ,  o,P.  f  R  ,  (X 

71  \  a  v  p.  / 


■  < 


v  p  >  1 


0 

7r 


a  =  p=  el0,  0  <  n  <  it 


l.i.m  ioNOf) 


- 


I  C0S'1(f^)’  a’e  *  Rl’  !u|  ''  l/Jl  '  1 

l  cos-1(^/)>  a  =  fT  =  ce1''>  lol  >  1,  0  <  n  < 

r  cos"1f  -ct-A  B  V  a,P  f  R1,  | a |  a  1  r ]  <  1 


a  a  £ 


a  =  B  =  e1 0 ,  0  <  0  <  tt  . 


8 
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Remark.  For  the  case  a  =  6 


p  >  1 ,  0^0,  the  1 imi t 


1  im 

t-w° 


Extxt+k 

yfcv?r  X2 
/tXttXt+k 


(3.8) 


need  not  exist  for  every  k.  To  see  this  put  £  -  r,  =  0.  Then 


EX2  =  2p2Re  1  -yU- 
1  1  p  sin  e 


i-02(t+1)  i-  2(t+i)ei2(t+i)e  i2e 


1-  o 


1  -  ?e~i2° 


and 


ExtXuk  =  2pk+2Re 


2  .  2 
p4sin  0 


iko  j(2+k)e 


l-  p‘ 


.  2  i  20 

1  -  p  e 


The  problem  lies  in  the  fact  that  e^2^+^^  does  not  have  a  unique  limit 
as  t  -*■  00  and  that  this  term  cannot  be  eliminated  in  the  corresponding 
ratios.  More  precisely,  let 


a 


1  -  p 


1 _ 

2i  20  ’ 
e 


Then  a  >  b.  Take  a  subsequence  { ts }  of  {1,2,...}  such  that 

it  0 

lime  S  =  e1U,  u  €  ( 0 , 2-n  ] . 


Then 

EX  X 

t  t  +k  a  cos  ko  +  b  cos(u+4o+k0+a) 

1  im  s  s-  -  = - r  • 

t-H»  All  EX*  .  { [a  b  cos(u+40+a) }  (a  +  b  cos(u+4O+2k0+2)]}'-: 

t  l 


But  this  limit  depends  on  u  and  so  3.8  need  not  exist  for  a  given  k,0. 
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4.  The  case  of  unit  roots 

The  most  interesting  case  occurs  when  the  equation 
(1  -  ctx)(l  -  Bx)  =  0  has  two  unit  roots  eie  and  e~i0,  0  <  e  <  tt .  In  this 
case  (3.1)  reduces  to 

Xt  *  2  cos  6  Xt_j  -  Xt  2  +  ct,  0  <  e  <  tt.  (4.1) 

By  Theorem  3.1  then  the  ZCR  1?^ ( if) / N  converges  to  O/tt  as  N  -+  ■». 

Figure  4.1  shows  a  typical  realization  of  (4.1)  for  e  =  tt/6.  The  process 
oscillates  as  a  sinusoid  except  that  the  amplitude  tends  to  increase  with  t. 
Because  of  the  sinusoidal  oscillation  the  rate  of  convergence  of  the  ZCR 
is  very  fast  and  is  essentially  identical  to  that  observed  in  a  pure 

sinusoid.  In  other  words,  the  ZCR  of  (4.1)  is  the  same  whether  a 2  is 

e 

large,  small  or  even  0.  This  is  illustrated  in  Table  4.2.  The  fast  rate 
of  convergence  is  displayed  in  Figure  4.2  and  Tables  4.1,  4.2.  Conversely, 
a  fast  rate  of  convergence  of  the  ZCR  is  a  very  good  indication  of  the 
presence  of  unit  roots. 


Z(t)«2  COs(r/4)Z(M)-2(t-2)+U(t) 


Figure  4. 2 .  ZCR  paths  of  AR(2),  =  1,  with  unit  roots  at  e 

^  l  t/3 

and  e"  .  The  convergence  is  towards  1/4  and  1/3  respectively 
(P(N)/,N  =  VM)/M 
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Table  4.1.  Convergence  to  0/ir  of  0^(y)/N,  N  =  10  ,  510  ,  1010  ,  1510  , 
2010  ,  ...  ,  10010,  from  the  model  (4.1)  with  =  1.  The  rate  of  con¬ 


vergence  is  fast. 


9/ 7f  =  0.15915 


6/ti  =  0.79577 


N 

°e  =  0 

o2  *  (8976)2 

o2  =  0 
c 

a2  =  (7-106)2 

10 

0.20000 

0.20000 

0.80000 

0.70000 

510 

0.15882 

0.16078 

0.79608 

0.79412 

1010 

0.15941 

0.15941 

0.79505 

0.79505 

1510 

0.15960 

0.15894 

0.79536 

0.79536 

2010 

0.15920 

0.15920 

0.79552 

0.79552 

2510 

0.15936 

0.15896 

0.79562 

0.79562 

3010 

0.15914 

0. 15880 

0.79568 

0.79568 

3510 

0.15926 

0.15897 

0.79573 

0.79573 

4010 

0.15910 

0.15910 

0.74576 

0.79551 

4510 

0.15920 

0.15898 

0.79579 

0.79557 

5010 

0.15928 

0.15908 

0.79581 

0.79561 

Absolute 

Error 

N  =  5010 

0.00013 

0.00007 

0.00003 

0.00017 

Initial 

values 

Xl  = 5000. 

X2  =  -1256. 

Xj  =  33. 

X2  =  55. 

2 


T*b1e  4-2-  Convergence  to  0/n  of  t>N(*)/N  from  the  model  (4.1)  with 
very  large  or  0.  The  convergence  is  essentially  independent  of  a2. 


o 
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The  last  remark  that  unit  roots  correspond  to  a  fast  rate  of  ZCR 
convergence  can  be  illustrated  by  the  model  (3.1)  with  a  =  $  =  pe10, 
0<p<l.  In  this  case  (3.1)  becomes 

Xt  =  2p  cos  0  Xtl  -  p2Xt_2  +  ct  ,  (4.2) 

where  0<  p  <1  means  that  (4.2)  has  a  stationary  solution  while  p  =  1 
corresponds  to  two  unit  roots  and  (4.2)  does  not  have  a  stationary  solu¬ 
tion.  By  Theorem  3.1 

V*)/N  ^  co  ;  lCos'1|^-c-°-y  j  .  (4.3) 

Table  4.3  gives  the  ZCR  for  N  =  10  ,  210  ,  410  ,  610  ,  . . .  ,  5010, 

P  =  0  ,  0.5  ,  1,  and  0  =  2.5.  From  the  table  it  is  evident  that  the 
rate  corresponding  to  p  =  1  is  faster  than  in  the  other  two  cases. 
(Note  that  p  =  0  means  that  is  white  noise.)  Again,  as  in  the 
first  order  case,  the  ZCR  path  corresponding  to  the  "nonstationary" 
case  is  much  smoother  than  the  paths  produced  by  the  "stationary" 


series. 
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,48824 

- .  0.1 1  78 

.  4896? 

~  ,  0 1  0  3  7 

,4885.1. 

-.01149 

.48790 

-.01210 

,  48671 

-.01539 

,  48692 

-  ,01308 

.  49472 

- .00528 

.49584 

- ,00416 

.49423 

- , 00577 

.4937? 

- . 00623 

,49216 

-  ,00784 

,49093 

-  .0090? 

.491.-8 

- . 00824 

. 49757 

- .00748 

,49441 

( 1  \  1 5  *'i  (v 

p  =  0.5, 

6  =  2.5 

oi  =  0. 

>2144 

ZCR 

ERROR 

.  70000 

- .02144 

.  7428.’' 

.02 f  41 

, 72439 

, 00295 

.  731 1  5 

. 009 "0 

.  72963 

, 008 1 8 

. 73960 

. 01816 

.73223 

.01079 

.73475 

.01331 

,7341,:. 

.01272 

.73425 

.01281 

. 73284 

.01 139 

, 73077 

,00932 

. 73320 

: 01 ! 75 

.73180 

. 01036 

. 72989 

.  00845 

.  7.2791 

. 00646 

. 72368 

,  00223 

. 72463 

.  00319 

. 72478 

,.  0079  .5 

, 72520 

00375 

.72369 

.  00225 

,  72399 

,00255 

. 72358 

.  00214 

. 72256 

<  00.1  11 

, 7239 1 

, 00246 

. 72236 

00091 

p  =  1 ,  0=2.5 

to  =  0.79577 


ZCR 

ERROR 

, 70000 

v  0  9  5 '?  7 

, 79048 

- . 00 5 30 

. 79768 

-  .  00309 

. ?9508 

. 00069 

,  79506 

.  0 (>(<  7  1 

.  7 9.  .  04 

.  00026 

. 79587 

.00009 

. 79574 

.00003 

, 79565 

-.00012 

.  79613 

,  00036 

79602 

. 00025 

, 79593 

,0001.5 

79585 

,00008 

. 795-9 

,00001 

, 79573 

- .  00005 

. 79568 

- , 00009 

, 79564 

-  ,  000 1  4 

.  79560 

-.00017 

. 79584 

. 00007 

.  79580 

.00003 

.  79576 

-  .  0000 .1. 

,  79572 

- . 00005 

:•  79569 

. 00008 

. 7° 566 

,  ooo  1. 1 

. 79584 

. 00007 

. 79581 

, 00003 

Table  4.3.  Convergence  of  N  =  10  ,  210  ,  410  ,  610  ,  . . .  ,  5010, 

from  4.2  with  c2  =1,  X,  =  10.185,  X,  =  -5.114.  ERROR  =  ZCR  -  w, 

G  i  C 

oi  given  in  4.3.  The  ERROR  column  indicates  the  rate  of  convergence.  . 
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4.1.  Multiple  unit  roots  and  2CR  of  differenced  series 

As  noted  in  the  introduction,  at  present  it  is  not  entirely  clear 
how  to  extend  our  results  to  the  case  of  multiple  roots.  However,  we 
conjecture  that  the  ZCR  of  the  filtered  series  may  determine  these  roots. 
An  indication  of  this  fact  is  now  outlined. 

Let  V  :  1  *B  be  the  difference  operator  and  consider  the  ZCR  of 

k  i9l  i02 

(V  X^}.  Suppose  the  unit  roots  are  recorded  as  e  ,  e  ,...,  where 

0  <  0j  <  @2  <  <  it.  Then  under  some  conditions,  as  k  -*•  the  ZCR 

for  large  N  converges  to  the  greatest  Q./v.  We  can  illustrate  this 
idea  by  examples.  Figure  4.3  displays  the  ZCR  paths  obtained  by  re¬ 
peated  differencing.  The  lowest  path  corresponds  to  no  differencing, 
the  one  above  it  corresponds  to  the  ..st  difference  and  so  on.  This 
monotonicity  is  due  to  repeated  differencing  which  acts  as  sequential 
highpass  filtering.  In  the  two  cases  in  Figure  4.3  the  roots  are 
e_lTr,  and  e1  i 0. 85tt ^  e± i 0. 1  57t ^  reSpectively,  and  the  processes 

are  AR(4).  In  both  cases  convergence  to  the  greatest  e  -/tt  occurs  as 

J 

k  oo,  we  shall  pursue  this  line  of  thought  elsewhere. 


RATE  PROCESSES  FOR  NONSTATIONARY  AR(4! 


0  200  400  600  800  1000 


Figure  4.3.  ZCR  paths  from  differenced  AR(4),  k  =  0,1,. ..,7,  with 
four  unit  roots  converging  to  the  largest  e^/ir.  In  (a)  all  the  paths 
are  the  same.  In  (b)  the  convergence  of  the  paths  tc  a  straight  line 
is  fast.  (P(N)/N  =  Pw(/)/N) 
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